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Abstract 

In complex systems, it is quite common to resort to approximations when optimizing system 
performance. These approximations typically involve selecting a particular system parameter 
and then studying the performance of the system as this parameter grows without bound. In- 
dexing this parameter by n, we prove that if the approximation to the objective function is 
accurate up to 0{f{n)) for some function f{n), then under some regularity conditions, the pre- 
scriptions that are derived from this approximation are in fact o(/(n))-optimal. A consequence 
of this result is that the well-known square-root staffing rules for capacity sizing in M/M/N 
and M/M/N + M queues to minimize the sum of linear expected steady-state customer waiting 
costs and linear capacity costs arc o(l)-optimal, i.e., their optimality gap is asymptotically zero. 

1 Introduction and Framework 

Introduction. Queueing theory has a rich history of using approximations to derive near-optimal 
prescriptions to optimization problems. These approximations typically consider a sequence of 
systems with increasing system scale, which is modeled by increasing arrival rates, and then ap- 
proximate the performance measures of interest. For instance, the problem of selecting the optimal 
capacity to minimize the sum total of linear expected steady-state customer waiting costs and lin- 
ear capacity costs requires an approximation of the expected steady-state queue-length. Suppose 
one has an approximation of this performance measure, then a capacity prescription is arrived at 
by optimizing the objective function obtained by replacing the actual performance measure by its 
approximation. If this approximation is accurate up to then one expects that the corre- 

sponding prescription would inherit the 0{f{n)) accuracy. It turns out that, under some regularity 
conditions, this prescription is far more accurate and in fact exhibits an accuracy of o(/(n)), i.e., 
the optimality gap when divided by f{n) converges to zero as n grows without bound. Further, 



""^For functions /, g : N — i- K: g{n) is said to be 0{f{n)) if limsup„_^^ < °Oi ^'Hd g{n) is said to be 

if lim„^oo \g{n)/f{n)\ = 0. 
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in many queueing applications the performance measures of interest can be approximated up to 
0(1), and in these cases our results imply that the capacity prescriptions are o(l)-optimal, i.e., the 
optimality gap of the prescriptions is asymptotically zero. 

Framework. Consider a sequence of systems indexed with n and let n„ denote the objective 
function in system n. The goal of the system manager is to solve: 

inf Unix), (1) 

where X„ is a set of feasible decisions. We assume that all optimizers of ([1]) lie in Let x* 
denote an optimizer and 11* the optimal value function. 

Suppose the following relation has been established for the system under consideration: 

'^nignix)) =an + bnTt{x)+7r{x) + enix), fOT X G Xn, (2) 

where the following conditions hold: 

1. gn '■ Xn — )• Xn are one-to-one and onto functions, where the sets X„ lie in a metric space 
(M, d). Further, we have Xn ^ Xn+i, and defining X = U'^^^Xn, we have vf, vr : X — t- M and 

Cn : Xn —5- K; 

2. an G M, 6„ G M+, and lim„_^oo &n = oo; 

3. inf^gjf Tt{x) > — oo and all optimizers of inf^gj^ 7f(x) lie in X; 

4. TT is continuous at every x G argmin^^jf 7f(x); 

5. For any sequence {x„ G X}n-, we have liminf„_j.oo(7r(x„) + e„(x„)) > — oo; and 

6. For any x G arg min^^gj^ vf (x) there exists (5^ > so that lim„^oo ^^]?{yeX:d(x,y)<&^} \^n{y)\ = 0. 

2 Optimality Gap of Approximate Solution 

Given the approximation ([2]), it seems reasonable to solve the optimization problem 

min7f(x), (3) 

and then use one of its optimizers to obtain a prescription for the original system with the knowledge 
that ([2]) implies that the performance of this prescription will be near optimal. Formally, we define 
X* to be an optimizer of ([3]) such that 7r(x*) = min^gj^, t^{x), where X* = arg min^gjjf vf (x). That 
is, X* is an optimizer of ^ with the smallest value of vr among all optimizers of ([3]). Then, the 
following result proves that the prescription gn{x*) has an optimality gap of o(l) for the optimization 
problem ([1]). 
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Theorem 1. If the objective function satisfies ^ along with conditions 1-6, then gn{x*) is 
0(1) -optimal for the optimization problem i.e., we have 

^n{9n{x*)) — n* — )• as n —)• 00. 

Proof. We can write the optimahty gap of the prescription as 



< 



Tln{gn{x*)) - = (ffn (2;*)) - a„ - 6„7r(x*) - IT^ - ttn - hn'n{g^ (j;*)) (4) 

7f(x*) -7f(5f~^«)) 



where n is large enough so that x* S X„. 

For the first term on the right-hand-side of (jl]), using ([2|) and the fact that lim„_i.oo kn C^i*)! = 
(which follows from condition 6), we have 



lim 



lin{9n{x*)) - an- hnTT{x*) = Tt{x*) 



(5) 



We next evaluate the second term on the right-hand-side of @ . Using the optimality of , we 
have 

n„(x;^) - an . Iin{gn{x*)) - a„ 
lim sup < lim sup 



7r(x*) -|- lim sup 



7r(x*) + en(rg*) 

hn 



(6) 



where the first equality follows from ([2|) and the second equality follows from the fact that 7r(x*) is 
bounded, which is a consequence of the continuity of vr at x*, and the fact that \\mn^oo \^n{x*)\ = 0. 
Considering the sequence {gn^{Xn)} n, we also have 



lim inf — = lim inf 



7r(5n^«)) + 
> liminf7f(ff-i(x;)), 



^i9n «)) + en(5'„ «)) 



(7) 



where the inequality follows by noting that condition 5 implies that liminf„^oo[^(9n^(^n)) + 
e„(5~"'^(a;* ))] > — oo. Comparing ([6]) and d?]), we obtain 

liminf 7f(g~^(x*,)) < Tt{x*) 



It follows that all cluster points of the sequence {9„/(2:Ji)}n niust be optimizers of Let us now 
consider a subsequence indexed by Uk such that Qnlixni) — >• a; as /c — )• oo for some x G X* . Using 
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([2]), we can then write 



hm 

k—^oo 



J-^nfc ~ "rife 



bn^T^igJ ix*n,)) = lim TriOnHx* )) = Tf{x), 



fc— ^oo 



(8) 



where the first equahty follows because there exists 6x > such that lim„_j.oo s^P{y£X:d{x,y)<Ss:} 
and the second equality follows from the continuity of vr at x. 

Finally, consider the third term in the right-hand-side of (jH . The optimality of x* and the fact 
that gn^{Xn) G Xn C X implies that 



7t{x*) - Tr{g^ {x*J) 



< 0. 



(9) 



Combining ([5]), <^ and dHD in (g]), we obtain 



< lim sup 



nn,(<?n,(x*))-n* <7rix*)-m- 



Using the fact that 7r(x*) = min^g^, 7r(x) and x G X*, we obtain 7r(x*) < 7t{x), which implies that 
limsupfc_^oQ n„j, (x*)) — 11* = and this completes the proof. 



Generalization of Theorem [H Consider the following general version of ([2]): 

^n{gn{x)) = On + 6„,vf (x) + Cn [n{x) + e„(x)] , 



□ 



(10) 



where conditions 1-6 hold as before, and in addition, we have c„ = o(6„). Then, proceeding as in 
the main result, we obtain that x* defined as before is o(c„)-optimal for the optimization problem 
([1]), that is, we have 

n„(5n(s*)) - 



0, as n — )■ oo. 



(11) 



3 Queueing Applications 

3.1 o(l)-optimality of square-root staffing in M/M/N queues 

Consider an M/M/N queue in which customers arrive at rate n per unit time and have a mean 
service time of l//i time units. Suppose the system manager faces a capacity planning problem in 
which she needs to select the number of servers to minimize to tal system costs, w hich include delay 



costs and capacity costs. Such a problem was considered in iBorst et al.l (j2004l ) and we consider 
a linear version of this problem in which the customer delay cost is h per customer per unit 
time and the cost per server is c per unit time. Then, the total system cost of staffing x servers is 
n„(x) = hKQn{x) + cx, where Qn{x) is the steady-state queue-length (number of customers waiting 



in the queue) and we can write its expected value as E(5„(x) 



n 



1 



Xfj,~n 



C{x,n), where C{x,n) 



is the blocking probability, i.e., the probability that all servers are busy. Although the function 
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C{x,n) is defined only for integers, following I Janssen et al.l (|201ll ). we note that an extension to 



( 2011 



real numbers is obtained by using C{x,n) 
optimization problem n iin^c(n //, nn) n„(x). 

Using Theorem 2 of I Janssen et 
we can write 

EQn(5n(x)) 



So, we can consider the 



and defining gn{x) = ^ + 



-q{x) + q{x) + en{x) 



^x for X € Xn = (0, oo). 



(12) 



where 



_ 1 A _^ x$(x) 
X \ (l){x) 



j{x) = x^q{xf 



1 X 
3 "6 



2 $(x) 
+ 



4){x) 



X X 

2 "6 



(13) 
(14) 



with $ and (j) denoting the cumulative distribution and density functions of the standard normal 
distribution, respectively, and Cn satisfies liminf„_>.oo en(xn) > — oo for any sequence {x„ G X}n 
and we have that for any x G X there exists 5x > Q such that lim„_>.oo s^V{y(^X:d{x,y)<Sx} \^n{v)\ = 0. 
We can then write the following approximation for Iln- 



n„(5f„(x)) = c- + . -7r{x) + 7t{x) + en{x), 

fj- V 



(15) 



where Tr{x) = cx + hq{x), tt{x) = hq{x), and e„ = /ie„(x). It can be verified that all the conditions 
1-6 are satisfied. 

It is easy to check that 7f(x) has a unique minimizer x* . The corresponding staffing rule 
- + \ -X* is the well-known square-root staffing rule. As the objective function here satisfies ([2|) 



an d conditions 1-6, Th eorem [T] implies that the square-root staffing rule is o(l)-optimal. 



Janssen et al 



(|201ll ) refines the square-root staffing rule by incorporating the function ■n{x) into 
the optimization problem and prove that the refined staffing prescription thus obtained is optimal 
up to 0{\/\/n). It turns out that the squar e-root staffing rule without any refinement is also 
optimal up to 0{l/^/n). To see this, note that I Janssen et al.l (120 111 ) proves that e„(x) = 0{l/^/n)^ 



and thus the proof of Theorem [T] implies that the capacity prescription ^ + y ^2;* itself would 
be optimal up to 0(l/^/n) . Thu s, our result suggests that the refinement to square-root staffing 
computed in I Janssen et al.l (j201ll ) should in fact be o(l/-y/n)-optimal. 

3.2 o(l)-optimality in M/M/N + G queues 

Consider the same setup that we used for the M/M/N queues in the previous section with the 
addition of customer abandonments. In particular, customers are endowed with a patience dis- 
tribution with cumulative distribution function G, a density function g that is strictly positive 
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and continuously difFerentiable on [0, oo), and mean I/7, such that the time customers are wihing 
to wait is distributed according to this distribution in an i.i.d. fashion. Consider the same opti- 
mization problem considered previously, namely, to select the number of servers (extended to real 
numbers) to minimize linear customer delay costs and linear capacity costs, i.e., min^g[o,oo) ^nix), 

where Iln{x) = hEQnix) + ex. 

Using Theorem 5 of iBassamboo and Randhawal ( 20ld ) and defining iD{x) = G~^(min(l, x/^t)) 
with G = 1 — G, gn{x) = nx for x € X„ = [0, 00), we can write 



EQn{gn{x)) = nq{x) + q{x) + en(x). 



where 



q{x) 
q{x) 



w{x) 



G{w)dx, 

g'jwjx)) 
2 \pg^{tv{x)) 



+ 1 



and we have that for any x < l/fi there exists Sx > such that lim„_j.oo sup^y^x.^^^^ y)<5x} \^n{y)\ = 
0. (Note that the referred theorem only proves that q{x) = 0(1), but the same proofs also yield the 
additional properties listed here. Furth er the case x <1/m corresponds to the overloaded regime, 
or efficiency driven regime as defined in lGarnett et al.l (j2002l ). in which offered load exceeds unity.) 



This is the so-called fluid approximation of the queueing system. We then have the following analog 
of ©: 



n„(fl'„(x)) = n7r(x) + 7r(x) + e„(2;). 



(16) 



where 7f(x) = cx + hq{x), 7r{x) = hq{x), and e„(x) = hen{x). It is easy to establish that conditions 
1 through 5 are satisfied here, and that x € X* satisfy x < l//i so that condition 6 is satisfied 
only when l/^i ^ X* . Note that if l/^i ^ X* , then the capacity prescriptions obtained from 
the approximations lead the system into an overloaded regime. Theorem [1] then implies that if 
1//X ^ X* , then gn{x*) is an o(l)-o ptimal solution to the cost minimiz ation problem ([TJ and thus is 
more accurate than that proved in IBassamboo and Randhawal (j20ld ) , which only proved that this 



fluid-based prescription is C'(l)-optimal. 

However, if we have 1//U G X* , which is equivalent to stating that the optimal capacity prescrip- 
tion leads the system to the critically loaded regime, then we do not obtain the o(l)-optimality of 
the fluid-based prescription. In fact, in this case square-root staffing is the o(l)-optimal solution, 
and identifying it requires a refined approach, which is the diffusion approximation. In particular, 
we set gn{x) = - + \/-x with X„ = [—-s/n/p, 00) and expect the following approximation to hold: 



EQn{gn{x)) 



-Qi{x) + qi{x) + en,i{ 



(17) 
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We expect the above approximation to ho ld for generally distributed patience times, especially 
given the recent work 



Gurvich et al 



(12013) which proves that [EQnign{x)) - y/^gi(xl)js_0{ll 
For th e case of exponentially distributed patience times, i.e., M /M/N + M queues , IZhang et al 
has recently established (|17|) . In particular. Theorem 5 of IZhang et al.l (|2012l ) can be used 
to obtain 



qi{x) = nqi{x 



^ HJx) — x\ —AJx), 
/ 7 



-h^(x)A:t,(x) - \x^HJx). — + \. —xH^ix) ( . —H^(x) - x 

6 VtSV/^ VVa* 



where defining G{x) = 



Hj{x) 



we have 

^(-xvWt) V V 



G{x)H^{x)J^ - xG{x)^ + 1 + xG{x) 



(18) 



h,{x) = -\\P^^^^H,{x) ^ , ,^ 

It follows that we can write the approximation to the cost function in the following form: 

Tl I Tl 

^nignix)) = c- + J-7fi(x) + 7ri(a;) + e„,i(x). 

It can be established that conditions 1-6 hold so that the optimal square-root staffing ^ 't- 
is o(l)-optimal, where x\ minimizes vfi and satisfies the relation tti[x'[) = min^gjj* t:i[x)^ where 
XI = argmin^.gjf^ 7fi(x). 

4 Discussion 

We have characterized the optimality gap of prescriptions for optimization problems obtained using 
asymptotic approximations for the objective function. We have discussed a couple of applications 
to capacity sizing problems in M/M/N and M/M/N + G systems, and it is easy to see that the 
results are applicab l e mor e generally, for instance, to pricing problems of the form introduced in 
Maglaras and Zeevil (j2003l ) as long as one can establish an analog of Although the examples 
we have discussed pertain to unconstrained cost minimization, our results apply to constrained 
optimization as well by appropriately incorporating the constraints into the feasible set. However, 
depending on the nature of the constraints, conditions 1-6 may not hold. For instance, in an 
M/M/N queueing system, consider the problem of minimizing the number of servers to ensure 
that the probability of waiting (before beginning service) is less than a threshold. In this case, the 
results of 



Janssen et al. 



()201ll ) imply that square-root staffing is only 0(l)-optimal, and indeed we 
can verify that condition 1 is violated, in particular X„ ^ ^n+i (which implies that ^ need not 
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hold). 

In conclusion, I would like to point out that in this paper we have not discussed the issue 
of optimal control in queueing systems, which is an important topic. In fact, some recent work 
on this topic has a similar flavor of asymptotic optimality where a control policy derived using 
an approximation that is accurate up to a certain order leads t o an optimality gap of a smaller 



order. For instance, in a dynamic matching queueing application iGurvich and WardI (|2012l ) proves 
that a policy derived from solving a static problem, that has an accuracy gap of 0{^/n), in a 
dynami c manner (a discrete-revie w policy) leads to o(-y/n)-optimality. In a revenue management 
setting, iReiman and Wand (j2008l ) proves that the solution to a static optimization problem, which 
is expected to hav e an a ccuracy gap of 0{^/n), when resolved once is o(T/n)-optimal, and recently 



Jasin and Kumarl (j2012l ) proves that re-solving this optimization problem many times can lead to 



C'(l)-optimality. While these results appear similar at first glance, the dynamic resolving of the 
static optimization problem allows the approximate control solution to "re-align" with the actual 
system. This feature is missing in the problems that we have studied here. Nevertheless, the 
similarity is interesting and calls for a further, potentially unifying, study. 
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